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(54) Shopping assistance service 

(57) A shopping assistance method and service 
system is provided in which a shopper captures infor- 
mation about an item of interest (90) and sends it over 
a mobile radio infrastructure (10) to a service system 
(40). At the service system, the information is processed 
to identify at least the type of item of interest. A deter- 
mination is also made of a location associated with the 
information, this location will generally be that of the 



store (92) where the shopper captured the information, 
but could also be the shopper's home location. The serv- 
ice system next carries out a specific task (72) relating 
to the identified item (90), such as obtaining compara- 
tive prices, and then provides a report back to the shop- 
per, the contents and/or organisation of the report taking 
account of the location previously determined as being 
associated with the infomnation. 
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Description 

Field of the Invention 

[0001 ] The present invention relates to a shopping as- 
sistance service system and method and, in particular, 
but not exclusively, to such a service system and meth- 
od utilising the information capture and processing 
methods and apparatus of ourco-pending UK patent ap- 
plication 9927349.2. 

Background of the Invention 

[0002] Communication infrastructures suitable for 
mobile users (in particular, though not exclusively, cel- 
lular radio infrastructures) have now become widely 
adopted. Whilst the primary driver has been mobile te- 
lephony, the desire to implement mobile data-based 
services over these infrastructures, has led to the rapid 
development of data-capable bearer services across 
such infrastructures. This has opened up the possibility 
of many Internet-based services being available to mo- 
bile users. 

[0003] By way of example, Figure 1 shows one form 
of known communication infrastructure for mobile users 
providing both telephony and data-bearer services. In 
this example, a mobile entity 20, provided with a radio 
subsystem 22 and a phone subsystem 23. communi- 
cates with the fixed infrastructure of GSM PLMN (Public 
Land Mobile Network) 1 0 to provide basic voce teleph- 
ony services. In addition, the mobile entity 20 includes 
a data-handling subsystem 25 interworking, via data in- 
terface 24, with the radio subsystem 22 for the transmis- 
sion and reception of data over a data-capable bearer 
service provided by the PLMN; the data-capable bearer 
service enables the mobile entity 20 to communicate 
with a service system 40 connected to the public Internet 
39. The data handling subsystem 25 supports an oper- 
ating environment 26 in which applications run, the op- 
erating environment including an appropriate communi- 
cations stack. 

[0004] More particularly, the fixed infrastructure 1 0 of 
the GSM PLMN comprises one or more Base Station 
Subsystems (BSS) 11 and a Network and Switching 
Subsystem NSS 12. Each BSS 11 comprises a Base 
Station Controller (BSC) 14 controlling multiple Base 
Transceiver Stations (BTS) 13 each associated with a 
respective "cell" of the radio network. When active, the 
radio subsystem 22 of the mobile entity 20 communi- 
cates via a radio link with the BTS 13 of the cell in which 
the mobile entity is currently located. As regards the 
NSS 12, this comprises one or more Mobile Switching 
Centers (MSG) 1 5 together with other elements such as 
Visitor Location Registers 32 and Home Location Reg- 
ister 32. 

[0005] When the mobile entity 20 is used to make a 
normal telephone call, a traffic circuit for canning digi- 
tised voice is set up through the relevant BSS 11 to the 



NSS 12 which is then responsible for routing the call to 
the target phone (whether in the same PLMN or in an- 
other network). 

[0006] With respect to data transmission to/from the 
5 mobile entity 20, in the present example three different 
data-capable bearer services are depicted though other 
possibilities exist. A first data-capable bearer service is 
available in the fomn of a Circuit Switched Data (CSD) 
service; in this case a full traffic circuit is used forcarry- 
10 ing data and the MSG 32 routes the circuit to an Inter 
Working Function IWF 34 the precise nature of which 
depends on what is connected to the other side of the 
IWF Thus, IWF could be configured to provide direct 
access to the public Internet 39 (that is, provide func- 
'5 tlonality similar to an lAP - Internet Access Provider 
lAP). Alternatively, the IWF could simply be a modem 
connecting to a PSTN; in this case, Internet access can 
be achieved by connection across the PSTN to a stand- 
ard lAR 

20 [0007] A second, low bandwidth, data-capable bearer 
service is available through use of the Short Message 
Service that passes data carried in signalling channel 
slots to an SMS unit which can be arranged to provide 
connectivity to the public Internet 39. 
25 [0008] A third data-capable bearer service is provided 
in the form of GPRS (General Packet Radio Service 
which enables IP (or X.25) packet data to be passed 
from the data handling system of the mobile entity 20, 
via the data interface 24, radio subsystem 21 and rele- 
30 vant BSS 11. to a GPRS network 17 of the PLMN 10 
(and vice versa). The GPRS network 17 includes a SG- 
SN (Serving GPRS Support Node) 18 interfacing BSC 
14 with the network 17, and a GGSN (Gateway GPRS 
Support Node) interfacing the network 1 7 with an extor- 
ts nal network (in this example, the public Internet 39). Full 
details of GPRS can be found in the ETSI (European 
Telecommunications Standards Institute) GSM 03.60 
specification. Using GPRS, the mobile entity 20 can ex- 
change packet data via the BSS 11 and GPRS network 
40 17 with entities connected to the public Internet 39, 
[0009] The data connection between the PLMN 10 
and the Internet 39 will generally be through a firewall 
35 with proxy and/or gateway functionality. 
[0010] Different data-capable bearer services to 
45 those described above may be provided, the described 
services being simply examples of what is possible. 
[0011] In Figure 1, a service system 40 is shown con- 
nected to the Internet 40, this service system being ac- 
cessible to the OS/application 26 running in the mobile 
so entity by use of any of the data-capable bearer services 
described above. The data-capable bearer services 
could equally provide access to a service system that is 
within the domain of the PLMN operatoror is connected 
to another public or private data network. 
55 [0012] With regard to the OS/application software 26 
running in the data handling subsystem 25 of the mobile 
entity 20, this could, for example, be a WAP application 
running on top of a WAP stack where "WAP" is the Wire- 
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less Application Protocol standard. Details of WAP can 
be found, for example, in the book "Official Wireless Ap- 
plication Protocol" Wireless Application Protocol Forum, 
Ltd published 1999 Wiley Computer Publishing. Where 
the OS/application software Is WAP compliant, the fire- 
wall will generally also serve as a WAP proxy and gate- 
way. Of course, OS/application 26 can comprise other 
functionality (for example, an e-mail client) instead of, 
or additional to, the WAP functionality. 
[0013] The mobile entity 20 may take many different 
forms. For example, it could be two separate units such 
as a mobile phone (providing elements 22-24) and a mo- 
bile PC (data-handling system 25) coupled by an appro- 
priate link (wireline, infrared or even short range radio 
system such as Bluetooth). Alternatively, mobile entity 
20 could be a single unit such as a mobile phone with 
WAP functionality. Of course, If only data transmission/ 
reception is required (and not voice), the phone func- 
tionality 24 can be omitted; an example of this is a PDA 
with built-in GSM data-capable functionality whilst an- 
other example is a digital camera (the data-handling 
subsystem) also with built-in GSM data-capable func- 
tionality enabling the upload of digital images from the 
camera to a storage server. 

[0014] Whilst the above description has been given 
with reference to a PLMN based on GSM technology, it 
will be appreciated that many other cellular radio tech- 
nologies exist and can typically provide the same type 
of functionality as described for the GSM PLMN 10. 
[001 5] Recently, must interest has been shown in "lo- 
cation-based", "location-dependent", or "location- 
aware" services for mobile users, these being services 
that take account of the current location of the user (or 
other mobile party). The most basic form of this service 
is the emergency location service whereby a user in 
trouble can press a panic button on their mobile phone 
to send an emergency request-for-assistance message 
with their location data appended. Another well known 
location-based service is the provision of traffic and 
route-guiding information to vehicle drivers based on 
their cun-ent position. A further known service is a "yel- 
low pages" service where a user can find out about 
amenities (shops, restaurants, theatres, etc.) local to 
their current location. The temn "location-aware servic- 
es" will be used herein to refer generically to these and 
similar services where a location dependency exists. 
[0016] Location-aware services all require user loca- 
tion as an input parameter. A number of methods al- 
ready exist for determining the location of a mobile user 
as represented by an associated mobile equipment. Ex- 
ample location-determining methods will now be de- 
scribed with reference to Figures 2 to 5. As will be seen, 
some of these methods result in the user knowing their 
location thereby enabling them to transmit it to a loca- 
tion-aware service they are interested in receiving, 
whilst other of the methods result in the user's location 
becoming known to a network entity from where it can 
be supplied directly to a location-aware service (gener- 
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ally only with the consent of the user concerned). It is to 
be understood that additional methods to those illustrat- 
ed in Figures 2 to 5 exist. 

[0017] As well as location determination, Figures 2 to 
5 5 also illustrate how the mobile entity requests a loca- 
tion-aware service provided by service system 40. In the 
present examples, the request is depicted as being 
passed over a cellular mobile network (PLMN 1 0) to the 
service system 40. The PLMN is, for example, similar to 
that depicted In Figure 1 with the service request being 
made using a data-capable bearer service of the PLMN. 
The service system 40 may be part of the PLMN itself 
or connected to it through a data network such as the 
public Intemet. It should, however, be understood that 
infrastructure other than a cellular network may alterna- 
tively be used for making the service request 
[0018] The location-determining method illustrated in 
Figure 2 uses an inertial positioning system 50 provided 
in the mobile entity 20A, this system 50 determining the 
displacement of the mobile entity from an initial refer- 
ence position. When the mobile entity 20A wishes to in- 
voke a location-aware service, it passes its current po- 
sition to the corresponding service system 40 along with 
the service request 51 . This approach avoids the need 
for an infrastructure to provide an extemal frame of ref- 
erence; however, cost, size and long-term accuracy 
concerns currently make such systems unattractive for 
incorporation into mass-market handheld devices. 
[0019] Figure 3 shows two different location-deter- 
mining methods both involving the use of local, fixed- 
position, beacons here shown as infra-red beacons IRD 
though other technologies, such as short-range radio 
systems (in particular, "Bluetooth" systems) may equally 
be used. The right hand half of Figure 3 show a number 
of independent beacons 55 that continually transmit 
their individual locations. Mobile entity 20B is arranged 
to pick up the transmissions from a beacon when suffi- 
ciently close, thereby establishing its position to the ac- 
curacy of its range of reception. This location data can 
then be appended to a request 59 made by the mobile 
entity 20B to a location-aware service available from 
service system 40. A variation on this arrangement is 
for the beacons 55 to transmit information which whilst 
not directly location data, can be used to look up such 
data (for example, the data may be the Internet home 
page URL of a store housing the beacon 55 concerned, 
this home page giving the store location - or at least 
identity, thereby enabling look-up of location in a direc- 
tory service). 

[0020] In the left-hand half of Figure 3, the IRB bea- 
cons 54 are all connected to a network that connects to 
a location server 57. The beacons 54 transmit a pres- 
ence signal and when mobile entity 20C is sufficiently 
close to a beacon to pick up the presence signal, it re- 
sponds by sending its identity to the beacon. (Thus, in 
this embodiment, both the beacons 54 and mobile entity 
20C can both receive and transmit IR signals whereas 
beacons 55 only transmit, and mobile entity 20B only 
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receives. IR signals). Upon a beacon 54 receiving a mo- 
bile entity's identity, it sends out a message over network 
56 to location server 57, this message linking the identity 
of the mobile entity 20C to the location of the relevant 
beacon 54. Now when the mobile entity wishes to invoke 5 
a location-aware service provided by the service system 
40, since it does not know its location it must include it's 
identity in the service request 58 and rely on the service 
system 40 to look up the current location of the mobile 
entity in the location server 57. Because location data io 
is personal and potentially very sensitive, the location 
server 57 will generally only supply location data to the 
service system 40 after the latter has produced an au- 
thorizing token supplied by the mobile entity 20B in re- 
quest 58. It will be appreciated that whilst service system is 
40 is depicted as handling service requests form both 
types of mobile entity 20 B and 20C, separate systems 
40 may be provided for each mobile type (this is likewise 
true In respect of the service systems depicted in Fig- 
ures 4 and 5). 20 
[0021] Figure 4 depicts several forms of GPS loca- 
tion-detemnining system. On the left-hand side of Figure 
4, a mobile entity 20D is provided with a standard GPS 
module and is capable of dGtcrmining the location of en- 
tity 20D by picking up signals from satellites 60. The en- 25 
tity 20D can then supply this location when requesting, 
in request 61 , a location-aware service from service sys- 
tem 40. 

[0022] The right-hand side of Figure 4 depicts, in re- 
lation to mobile entity 20E. two ways in which assistance 3o 
can be provided to the entity in deriving location from 
GPS satellites. Firstly, the PLMN 10 can be provided 
with fixed GPS receivers 62 that each continuously keep 
track of the satellites 60 visible from the receiver and 
pass Information in messages 63 to local mobile entities 35 
20E as to where to look for these satellites and estimat- 
. ed signal arrival times; this enables the mobile entities 
20E to substantially reduce acquisition time for the sat- 
ellites and increase accuracy of measurement (see "Ge- 
olocation Technology Pinpoints Wireless 911 calls with- 40 
in 15 Feet" 1-Jul-99 Lucent Technologies, Bell Labs). 
Secondly, as an alternative enhancement, the process- 
ing load on the mobile entity 20E can be reduced and 
encoded jitter removed using the services of network 
entity 64 (in or accessible through PLMN 1 0). 45 
[0023] One the mobile unit 20E has detennined its lo- 
cation, it can pass this infomnation in request 65 when 
invoking a location-aware service provided by service 
system 40. 

[0024] Figure 5 depicts two general approaches to to- so 
cation detemnination from signals present in a cellular 
radio infrastructure. First, it can be noted that in general 
both the mobile entity and the network will know the 
identity of the cell in which the mobile entity currently 
resides, this infonnation being provided as part of the ss 
normal operation of the system. (Although in a system 
such as GSM, the network may only store current loca- 
tion to a resolution of a collection of cells known as a 



"location area", the actual current cell ID will generally 
be derivable from monitoring the signals exchanged be- 
tween the BSC 14 and the mobile entity). Beyond cur- 
rent basic cell ID. it is possible to get a more accurate 
fix by measuring timing and/or directional parameters 
between the mobile entity and multiple BTSs 13, these 
measurement being done either in the network or the 
mobile entity (see, for example, International Applica- 
tion WO 99/04582 that describes various techniques for 
effecting location determination in the mobile and WO 
99/55114 that describes location determination by the 
mobile network in response to requests made by loca- 
tion-aware applications to a mobile location center - 
server- of the mobile network). 

[0025] The left-hand half of Figure 5 depicts the case 
of location determination being done in the mobile entity 
20F by. for example, making Observed Time Difference 
(OTD) measurements with respect to signals from BTSs 
13 and calculating location using a knowledge of BTS 
locations. The location data is subsequently appended 
to a service request 66 sent to service system 40 in re- 
spect of a location-aware service. The calculation load 
on mobile entity 20F could be reduced and the need for 
the mobile to know BTS locations avoided, by having a 
network entity do some of the work. The right-hand half 
of Figure 5 depicts the case of location determination 
being done in the network, for example, by making Tim- 
ing Advance measurements for three BTSs 13 and us- 
ing these measurements to derive location (this deriva- 
tion typically being done in a unit associated with BSC 
14). The resultant location data is passed to a location 
server 67 from where it can be made available to au- 
thorised services. As for the mobile entity 20C in Figure 
3, when the mobile entity 20G of Figure 5 wishes to in- 
voke a location-aware service available on service sys- 
tem 50, it sends a request 69 including an authorisation 
token and its ID (possible embedded in the token) to the 
service system 40; the service system then uses the au- 
thorisation token to obtain thecurrent location of the mo- 
bile entity 20G from the location server 67. 
[0026] In the above examples, where the mobile entity 
is responsible for determining location, this will generally 
be done only at the time the location-aware service is 
being requested. Where location detennination is done 
by the infrastmcture, it may be practical for systems cov- 
ering only a limited number of users (such as the system 
illustrated in the left-hand half of Figure 2 where a 
number of infrared beacons 54 will cover a generally 
fairly limited) for location-data collection to be done 
whenever a mobile entity is newly detected by an IRB, 
this data being passed to location sender 57 where it is 
cached for use when needed. However, for systems 
covering large areas with potentially a large number of 
mobile entities, such as the Figure 5 system, it is more 
efficient to effect location detemiination as and when 
there is a perceived need to do so; thus, location deter- 
mination may be triggered by the location server 67 in 
response to the service request 68 from the mobile en- 
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tity 20G or the mobile entity may, immediately prior to 
making request 68. directly trigger BSC 14 to effect a 
location determination and feed the result to location 
server 67. 

[0027] Further with respect to the location servers 57, 
67, whilst access authorisation by location -aware serv- 
ices has been described as being through authorisation 
tokens supplied by the mobile entities concerned, other 
authorisation techniques can be used. In particular, a 
location-aware service can be prior authorised with the 
location server in respect of particular mobile entities; in 
this case, each request from the service for location data 
needs only to establish that the request comes from a 
service authorised in respect of the mobile entity for 
which the location data is requested. 
[0028] As already indicated, Figures 2 to 5 depict only 
some examples of how location determination can be 
achieved, there being many other possible combina- 
tions of technology used and where in the system the 
location-determining measurements are made and lo- 
cation is calculated, stored and used .Thus, the loca- 
tion-aware service may reside in the mobile entity 
whose location is of interest, in a network-connected 
service system 40 (as illustrated), or even in another 
mobile entity. Furthermore, whilst in the examples of 
Figures 2 to 5, invocation of the location-aware service 
has been by the mobile entity whose location is of inter- 
est, the nature of the location -aware service may be 
such that it is invoked by another party (including, po- 
tentially, the PLMN itself). In this case, unless the invok- 
ing party already knows the location of he mobile entity 
and can pass this information to the location-aware 
service (which may, for example, may be situation 
where the PLMN invokes the service), it is the location- 
aware service that is responsible for obtaining the re- 
quired location data, either by sending a request to the 
mobile entity itself or by requesting the data from a lo- 
cation server. Unless the location server already has the 
needed infomnation in cache, the server proceeds to ob- 
tain the data either by interrogating the mobile entity or 
by triggering infrastructure elements to locate the mo- 
bile. For example, where a location -aware service run- 
ning on service system 40 in Figure 5 needs to find the 
location of mobile 20G, it could be arranged to do so by 
requesting this infomnation from location server 67 
which in turn requests the location data from the relevant 
BSC, the latter then making the necessary determina- 
tion using measurements from BTSs 13. 
[0029] Although in the foregoing, the provision of lo- 
cation data through the mobile radio infrastructure to the 
mobile entity has been treated as a service effected over 
a data-capable bearer channel, it may be expected that 
as location data becomes considered a basic element 
of mobile radio infrastructure services, provision will be 
made in the relevant mobile radio standards for location 
data to be passed over a signalling channel to the mobile 
entity. 

[0030] The present invention concerns a shopping as- 



sistance service whereby a user can obtain comparative 
prices of an item of interest whilst out shopping. The abil- 
ity to obtain comparative prices using mobile communi- 
cations is already known (see, for example, US 

5 6,134,548 that discloses a system in which a user can 
input a universal product code and receive back price 
information and reviews). The retrieval of product-rele- 
vant information, is also described In the above-men- 
tioned UK Application 9927349.2 where a hand-held 

10 scanner is used to capture information which is then 
sent, for example over a mobile communications link, to 
a remote processing system where the scanned image 
is used to enable a specified task (for example, provid- 
ing more information on the product to which the 

^5 scanned image relates; providing information on similar 
products; ordering the product; etc.). 
[0031] It is an object of the present invention to pro- 
vide an improved shopping assistance service method 
and system. 

20 

Summary of the Invention 

[0032] According to one aspect of the present inven- 
tion, there is provided a shopping assistance service 
25 method, comprising the steps of: 

(a) capturing information about an item of interest 
at a business premises where the item is being of- 
fered, and sending that information to a service sys- 

30 tem; 

(b) receiving the information at the service system, 
determining a location associated with the informa- 
tion, and processing the Information to identify at 
least the type of item of interest; and 

35 (c) carrying out a specific task relating to the iden- 
tified item and delivering an output, said location be- 
ing used to organise and/or select what is in said 
output. 

40 [0033] According to another aspect of the present in- 
vention, there is provided a shopping-assistance serv- 
ice system, comprising: 

receiving means for receiving at the service system 
45 information about an item of interest on offer at a 
business premises, said information including an in- 
dication of the location of said premises; 
processing means for processing the information to 
identify at least the type of said item of interest and 
50 the location of said premises; 

task means for carrying out a specific task relating 
to the identified item and delivering an output, said 
location being used to organise and/or select what 
is in said output. 

55 

[0034] According to a further aspect of the present in- 
vention, there is provided a shopping-assistance serv- 
ice system, comprising: 



30 



35 



50 
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receiving means for receiving at the service system 
information about an item of interest on offer at a 
business premises: 

processing means for processing the information to 
identify at least the type of said item of interest; 
location-detemnining means for detennining a loca- 
tion associated with the received information; and 
task means for carrying out a specific task relating 
to the identified item and delivering an output, said 
location being used to organise said output accord- 
ing to zones of different accessibility from said lo- 
cation. 
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Brief Description of the Drawings 



[0035] A shopping assistance service method and 
service system, both embodying the present invention 
wtll now be described, by way of non-limiting example' 
with reference to the accompanying diagrammatic 
drawings, in which: 



15 



20 



. Figure 1 
. Figure 2 

. Figures 

. Figure 4 
. Figures 

. Figure 6 
. Figure? 
. Figures 
. Figure 9 
Best Mode 



is a diagram of a known communications 
infrastructure usable for transferring 
voice and data to/from a mobile entity; 
is a diagram illustrating one known ap- 
proach to determining the location of a 
mobile entity, this approach involving 
providing the entity with an inertial posi- 
tioning system; 

is a diagram illustrating another known 
approach to detemiining the location of 
a mobile entity, this approach being 
based on proximity of the mobile entity 
to fixed-position local beacons; 
is a diagram illustrating a further known 
approach to detennining the location of 
a mobile entity, this approach involving 
the use of GPS satellites; 
is a diagram illustrating a still further ap- 
proach to determining the location of a 
mobile entity, this approach being based 
on the use of signals present in a cellular 
mobile radio communications system; 
is a diagram of a shopping assistance 
service system embodying the present 
invention; 

is a diagram illustrating possible target 
zones for reporting alternative sources 
of a selected item; 

is a diagram showing a web page provid- 
ing a personal catalogue of infonnation 
capturing during a shopping trip; and 
is a diagram illustrating different usages 
of the service system. 



25 
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40 
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Best Mode of Carrying Out the Invention 
[0036] The shopping assistance service method and 



55 



system embodying the invention wilt now be described 
with reference to Figure 6 which shows the service sys- 
tem 40 as connected to the public Internet 39. It is to be 
understood that the present invention is not limited to 
the specifics of the mobile entity 20, location discovery 
means, and communication infrastructure shown in Fig- 
ure 6; the generalisations discussed above in relation to 
Figure 1 to 5 regarding these elements apply equally to 
the operational context of the service system 40. Fur- 
thermore, whilst the service system 40 is shown as con- 
nected to the public Internet, it could be connected to 
the GPRS network 17 or to another fixed data network 
interfacing directly or indirectly with the network 17 or 
network 39; it will also be appreciated that any appro- 
priate data-capable bearer service (not just GPRS) can 
be used for passing data through PLMN 10. 
[0037] In the Figure 6 embodiment, the data handling 
subsystem 25 of mobile entity 20 runs a shopping aid 
application 26 (for example, a WAP application) by 
which the user can provide item data on an item of in- 
terest (for example, goods 90 displayed at a business 
premises 92 such as a shop or store), select a task to 
be carried out in relation to that item data, and send the 
Item data and task data via a data-capable bearer serv- 
ice of PLMN 10, WAP gateway 35, and intemet39 (see 
heavy dotted line), to a shopping assistance service sys- 
tem 40. System 40 processes the received data to effect 
the specified task, fetching additional information as 
needed, and then delivering the results in a manner 
specified by the user. The specified tasks can include 
collecting comparative pricing data for the item of inter- 
est, accessing reviews of the item, ordering catalogues, 
creating a personal shopping session catalogue for later 
reference (for example, from a home PC 79), etc. 
[0038] According to the present invention! the con- 
tents of the results information delivered by the service 
system are selected and/or organised by location as will 
be more fully described hereinafter. 
[0039] Item data is provided to the shopping aid ap- 
plication 26 by means of a capture transducer 27; in the 
present example .the capture transducer 27 is a' hand- 
held scanner which is used by the mobile-entity user to 
scan an infonnation label 91 associated with the item 
90 to generate image data. The image data is displayed 
to the user via a viewing interface 28 to enable the user 
to verify that the scan has been successful. The infor- 
mation label 91 includes, for example, a bar code iden- 
tifying the product as well as a text description and price. 
Details of a suitable scanner are given in our aforesaid 
co-pending UK patent application. 
[0040] The mobile entity also includes an interface 29 
which the user can use to select the specific task that 
the user wishes to be carried out in relation to the 
scanned-in item data; preferably this interface, or anoth- 
er interface of the mobile entity, permits the user to key 
in further data such as the explicit identity of the store 
90. Whilst the store identity may have been captured 
with the image data (for example, where the product bar 
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code is extended to include store identity data), includ- 
ing the store identity as an explicit data field facilitates 
processing and generally entering this data need only 
be done once in each store regardless of how many 
items of interest are scanned in. However, it should be 
noted that the store identity can be obtained in a variety 
of ways including from the location of the store as will 
be described hereinafter; accordingly it is to be under- 
stood that reference herein to store data for indicating 
the identify the store is to be broadly understood to en- 
compass any data enabling the identity of the store to 
be derived either directly or indirectly. 
[0041] The item data, task selection data, and any 
other input data are received at the shopping assistance 
service system 40 through web interface 41 and are 
handled by processing block 42. More particularly, these 
data are first subject to a preliminary processing 71 the 
purpose of which is to identify all the main data elements 
using, as necessary, the services of an image interpre- 
tation process 74, The main data elements are listed be- 
low. 

User Data 

The service system will have received user 
identity data when the user first connected to the 
service system and this is used to look up user pro- 
file data in database 43, the user profile data spec- 
ifying certain processing preferences as will be de- 
scribed below. 
Task required 

Generally this is a separate date element in the 
data passed to the service system and there is no 
difficulty in identifying and extracting this data. Al- 
ternatively, the user can specify in their user profile 
that a particular is always to be performed. More 
than one task can be specified in respect of the 
same item of interest. 
Item Identity 

The identity of the item (generally item type 
though possibly for valuable items the identity of the 
specific item instance) is extracted through 
processing of the item data (in the present example, 
the item data is image data though it would be pos- 
sible to have captured the item identity as explicitly 
entered data). The image processing is operative, 
for example, to read scanned-in bar code to identify 
a UPC (Universal Product Code) or to read 
scanned-in text using OCR (Optical Character Rec- 
ognition) technology. Alternatively, the image 
processing involves matching the captured image 
against a library of stored images (for example, im- 
ages of labels 91 provided by the store concerned), 
these images having associated data records giv- 
ing details of the associated items. 
Location 

The location of the store where the item data 
was captured can be obtained by any of the location 
discovery means described above with reference to 



Figures 2 to 5. In the present case, a location server 
67 of the PLMN 10 is queried through interface 36 
to obtain the location of mobile entity 20, Where the 
store identity is positively known then this could be 

5 used as an alternative way of discovering location 

by look-up in a database associating business iden- 
tity with location. 
Store Identity 

As already noted, the store identity can be em- 

10 bedded in the image item data or sent as a separate 
data item. Ratherthan having the user directly input 
the store identity or extracting it from the image item 
data, the process 71 of the service system can be 
arranged to map the user location to a business 

15 identity using, for example, a database 45 that pro- 
vides such mappings for a particular locality. Since 
multiple businesses may be in close proximity or 
one above another in a shopping mall, it is prefera- 
ble that process 71 provides interpreted item data 
to the database 45 to enable the latter to resolve 
ambiguities by matching the item type against infor- 
mation on the nature of the businesses concerned 
(database 45 including a business description of 
each business). Database 45 also holds contact de- 

25 tails (such as website URL) for the businesses on 
which it holds details (for this reason, database 45 
is provided even where business identity is not ob- 
tained by a location-to-business look-up); database 
45 can be an external resource accessed by service 

30 system over the internet. 

[0042] After the preliminary processing step 71 has 
extracted the main data elements, the specified task is 
executed (step 72) using an appropriate script retrieved 
35 from database 44. Depending on the nature of the task, 
this will generally involve contacting local and/or remote 
shopping infomnation databases 46,47 containing infor- 
mation such as pricing and availability of the identified 
item at other physical stores and virtual stores, orcon- 
40 tacting item informational resources relevant to the iden- 
tified item, such resources including product review 
websites, the website of the store where the item data 
was captured, the item manufacturer's website, etc. Re- 
trieval of information from these databases 46,47 and 
45 resources 48 is effected under the control of retrieval 
process 75. 

[0043] Where comparative pricing and/or availability 
information is required conceming the product, this is 
selected according to distance from a location focus, 
50 this distance being categorised according to the follow- 
ing zones: 

within convenient walking distance of the location 
focus; 

55 - within convenient driving distance of the location fo- 
cus; 

available from a virtual store over the internet with 
delivery to the location focus. 
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Convenrenr walking and driving distances are prefer- 
ably specified by the user In their user profile or specif- 
rcally input for any particular item of interest; the service 
system will use default values if the user has not spec- 
ified any values. Figure 7 illustrates these zones for the 
case where two different location foci are being used to 
constraint the fetching of comparative item price and/or 
availability data, one location focus being the user's cur- 
rent position (that is, the store where the item data has 
just been captured), and the other location focus being 
the usei^s home location as specified in the user profile 
data. The zones shown in Figure 7 are: 



21 - convenient walking distance of the user's cur- 
rent location; 

22 - convenient driving distance of the user's cur- 
rent location; 

23 - convenient walking distance of the user's home 
location; 

24 - convenient driving distance of the user's home 
location; 

25 - available from a virtual store over the internet 
with delivery to the current location or the user's 
home (here, there is no difference between the two 
though there could be, for example, in the case of 
travelling abroad). 

[0044] Following task execution, the task results are 
delivered (step 73) back to the user in any one or more 
of the following ways as specified by the used (either 
specifically for the current item enquiry or generically in 
the user's profile): 

■ by retuming an HTTP response over the same data 
channel across which the original enquiry was re- 
ceived by the service system; 

- by e-mail to the user's home e-mail address; 

- by creating a web page which is stored in data store 
49 for subsequent access by the user over the in- 
ternet via the service system's website and after ap- 
propriate authentication; 

- by printing and dispatch to the user using physical 
mail system; 

- by remote printing at the user's local (home / office) 
printer. 

Any other appropriate feedback mechanism can be 
used. With respect to the presentation of comparative 
pricing and availability data for an item, as already de- 
scribed this data is selected relative to one or more lo- 
cation foci according to certain distance criteria (ex- 
pressed above in temns of zones); the presentation of 
this information is preferably also presented according 
to those distance criteria, a list presentation format gen- 
erally being more convenient than a graphical one. 
[0045] In addition (or alternatively) to carrying out par- 
ticular infonnation retrieval tasks in respect of individual 
Items of interest, the service system is arranged to ex- 



ecute, for each item on which data is captured a store- 
to-catalogue task; this task stores in database 49 infor- 
mation about the item of interest concerned, this infor- 
mation being, for example, the item data itself, the main 
5 data elements extracted by the preliminary processing 
71 (including store identity), and timestamp data (includ- 
ing date). This item information, taken together for all 
Items, effectively fomis a catalogue of items of interest 
found during a shopping trip. Preferably the URLs of 
^0 relevant further infonnation resources for each item of 
interest are also stored, together with the URLs of web- 
sites of the stores visited (these URLs are obtained ei- 
ther as part of the preliminary processing or as part of 
the catalogue task itself). The store-to-catalogue task 
15 effectively includes the dispatch process, delivering da- 
ta to the database 49. 

[0046] When the user arrives back home, the user can 
access the service system 40 and ask for the day's per- 
sonal shopping catalogue to be displayed; this causes 
the processing block 42 to run a present-catalogue task 
that retrieves, from database 49, the user's item infor- 
mation for the current date and organises and presents 
this information back to the user via, for example, suit- 
able web pages. Since the stored item information in- 
25 dudes the store identity where each item data was cap- 
tured, the presentation of the personal shopping cata- 
logue is conveniently effected by store as illustrated in 
Figure 8 that depicts a web page presentation of the per- 
sonal shopping catalogue. More particularly for each 
30 store (here stores "PQR" and "XY2") there is a corre- 
sponding entry 81 each giving the store identity, a 
thumbnail 82 of each image item data captured at that 
store, and a corresponding text description of the item 
concerned (this being the item identity extracted during 
35 preliminary processing 71). 

[0047] Further infomiation in respect of displayed el- 
ements is made available by making such elements hot 
links; thus to access the website of a store, the user 
clicks on the store name thereby activating a hyperlink 
^0 to the store's website (the URL of which was previously 
found by the service system). Clicking on an item image 
thumbnail 82 brings up the full Image whereas clicking 
on the item description 83 brings up a list of further in- 
formation resources for that item and further tasks that 
45 can be undertaken (such as price comparison and avail- 
ability checks from other outlets, this information prefer- 
ably being locationally graded in the manner described 
above with reference to Figure 7). Another available 
task IS preferably a purchase task for purchasing the 
50 Item via the store concerned (this facility acts as an in- 
centive for stores to cooperate with the service system) 
[0048] Activating button 87 takes the user to a control 
menu from where the user can, for example, access and 
modify their user profile, choose to view their personal 
55 shopping catalogue for a different date, or display all 
item datas concerning a particular item type, regardless 
. of date of capture. 
[0049] Preferably, upon a user asking to view their 
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personal shopping catalogue for a particular date, in- 
cluding the current date, the present-catalogue task first 
presents the user with a map showing the stores visited 
(this being done using the store location data and a suit- 
able nnap database). The user can then select a store 
as an entry point into the shopping catalogue forthe day, 
the store entries 81 being arranged chronologically (ex- 
cept repeat visits to the same store on the same day are 
all included in the first entry for the store on that day). 
[0050] Conveniently, the shopping aid application 26 
permits the user to send null item data to the service 
system for the purpose of registering the presence of 
the user at a particular store regardless of whether item 
data is captured at that store. The service system proc- 
esses this input in the normal way except that it does 
not seek to extract item identity information or retrieve 
item-relevant information; the present-catalogue task 
uses the store data associated with the null item data to 
present the store in the personal shopping catalogue 
though no item element is displayed in respect of the 
null item data. Of course, if non-null item data is subse- 
quently captured at the store concerned, the null entry 
can be deleted. 

Variants 

[0051 ] As will be appreciated by persons skilled in the 
art, many variations are possible to the above described 
shopping assistance service method and system. For 
example, the location-dependency of comparative pric- 
ing and availability data can be solely reflected in how 
that information Is displayed instead of being used to 
determine what pricing and availability information is re- 
trieved. As well as location being a relevant parameter 
forthe comparative pricing retrieval and display, relative 
price may also be a parameter whereby only the lowest 
prices are returned to the user or even only prices lower 
than that at the user's current location. 
[0052] The items of interest can be services as well 
as products. 

[0053] Additionally or alternatively to the item data 
capture techniques described above, audio input is also 
possible, the user inputting a voice message as the item 
data which is then subject to audio processing by the 
preliminary processing step 71 to extract information 
such as item identity (and possibly also store Identity 
and task required). 

[0054] The mobile entity 20 can be arranged to carry 
out some of the preliminary processing of captured data 
itself before contacting the service system 40. Thus, the 
mobile entity can be configured to extract item identity 
and price information from the scanned image item data, 
possibly with the help of user input. 
[0055] Whilst in the described embodiment the item 
and store data has been transmitted to the shopping as- 
sistance service system 40 substantially at the time of 
capture, it is also possible for the user to capture and 
save the item and store data in a handheld device and 



latter download the captured data on one or more items 
to the service system 40 (for example, from a home PC). 
Furthermore, at least some of the preliminary process- 
ing and task execution can be effected by local process- 

5 ing resources of the user, though access will still be re- 
quired to remote information resources for pricing, avail- 
ability, review and other such Infomnation. 
[0056] Figure 9 depicts different degrees of involve- 
ment of the service system in relation to the building of 

10 a personal shopping catalogue by the user. The left- 
hand side of Figure 9 shows the situation already de- 
scribed above where mobile entity 20 equipped with a 
capture transducer scans label 91 of an item 90 of in- 
terest and sends the data at the time of capture (see 

15 arrow 1 1 0) via PLMN 1 0 and internet 39 to the shopping 
assistance service system 40 for preliminary processing 
and store-to-catalogue task execution (here both repre- 
sented by process 93). The user subsequently access- 
es the service system from home PC 79 and retrieves 

20 (arrow 111) personal shopping catalogue pages pre- 
pared by the present-catalogue task 94. The user may 
request follow up tasks such as price and availability 
comparison data (see arrow 112). 
[0057] The right-hand side of Figure 9 depicts the sit- 

25 uation where the user has a handheld device comprising 
elements 25 to 28 of the mobile entity 20 of Figure 6, 
together with adequate storage means for holding the 
captured data, and location discovery means (such as 
a GPS receiver). The captured item and store data is 

30 similar to that described above in relation to the Figure 
6 embodiment; however, the captured data is now re- 
tained in the device 120 rather than being transmitted 
over PLMN 1 0 to the service system. When the user re- 
turns home (arrow 113), the user downloads the cap- 

35 tured data into home PC 79. 

[0058] The processing of the captured data can now 
proceed in several different ways depending on the split 
of processing between home PC 79 and remote re- 
sources such as the service system 40; additionally cer- 

"fo tain processing (such as item identification) can be ef- 
fected either before or subsequent to presentation to the 
user of their personal shopping catalogue for the day. 
[0059] Thus, the simplest approach is to arrange for 
the home PC to pass all the captijred data to the service 

45 system 40 (see arrow 114) and allow the latter to carry 
out its processing substantially as in the Figure 6 em- 
bodiment in respect of the preliminary processing, store- 
to-catatogue and present-catalogue tasks (depicted to- 
gether as process 97 in Figure 9). A variant of this ap- 

50 proach is to have the service system carry out the pre- 
liminary processing and store-to-catalogue task but with 
the resultant item information being passed back to PC 
79 for local storage; in this case, PC 79 can conveniently 
carry out the present-catalogue task itself on the basis 

55 of the received item information received from service 
system 40. 

[0060] At the other extreme, the home PC can be ar- 
ranged to carry out all the functions of the service sys- 
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tern (depicted by process 96 in Figure 9), making refer- 
ence (arrow 115) to external resources 1 05 over internet 
39 where necessary to look-up data such as location- 
to-business identity and to access shopping data such 
as comparative prices and availability on a location-fo- 
cus-dependent basis. 

[0061] In one preferred arrangement, the captured 
data IS subject to initial processing 98 in PC 79 to identify 
the stores visited and obtain website contact information 
(this IS done, for example, by using captured location 
data to do a look up in an external location-to-business 
Identity database that also includes contact data) 
Thereafter no further processing is done until the user 
requests to see their shopping catalogue for the day At 
that time, a present-catalogue program is run to display 
by store, the captured image item data. The user can 
then ask for further information about a selected dis- 
played image item and this causes the present-cata- 
logue program either to analyse the image item data it- 
self or to contact the website of the store concerned (ar- 
row 116) and ask the store website 140 to match the 
image item data with image data held by that website 
Preferably, the user can intervene in the identification 
process to insert a clue (such as general item type); in- 
deed, the captured image item data can simply be used 
as a visual cue to prompt the user to input appropriate 
clue words to track down the product in a store cata- 
logue held by the store website. In this case, the capture 
transducer of handheld device 120 can conveniently be 
a digital camera. 

[0062] The user can also be responsible for inputting 
store Identity on the basis of visual prompting off the im- 
age Item data or otherwise. In this case, there is no need 
to capture store data whilst actually shopping; however 
capturing location data with each item data is a conven- 
ient way of associating items coming from the same 
store, though altemative mechanisms are possible (for 
example, the user can simply key in a store ID for each 
Item on which data is captured). 
[0063] As another variant, the item labels 91 can ad- 
vantageously include URL data referencing corre- 
sponding Item infonnation in the store's website cata- 
logue. In this case, the service system 40 or home PC 
79 can include appropriate means for extracting the 
URL data from the image item data and then, when pre- 
senting the personal shopping catalogue, either using 
the URL as a hyperlink that can be activated by clicking 
the image item data thumbnail 81 , or fetching a store 
catalogue image to be used in the personal shopping 
catalogue in place of the thumbnail. 
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Claims 



1 . A shopping assistance service method, comprising ss 
the steps of: 

(a) capturing information about an item of inter- 



est at a business premises where the item Is 
being offered, and sending that information to 
a service system: 

(b) receiving the information at the service sys- 
tem, determining a location associated with the 
infomation. and processing the information to 
identify at least the type of item of interest; 

(c) carrying out a specific task relating to the 
identified item and delivering an output, said lo- 
cation being used to organise and/or select 
what is in said output. 

2. A method according to claim 1 , wherein said loca- 
tion is that of the business premises where the item 
is being offered. 

3. A method according to claim 2, wherein said loca- 
tion is determined in one of the following ways: 

- by extraction from said information as specific . 
data included by the sender; 

■ by request to a location server of a mobile radio 
infrastructure through which said information 
has been sent to the service system from a mo- 
bile entity; 

- by reference to a database relating business 
identity to location, said information including 
the identity of the business where the item is on 
offer; 

- by processing of image data included in said 
information. 

. A method according to claim 1 , wherein said loca- 
tion is a predetermined location specified by the 
party responsible for sending the information to the 
sen/ice system either in a user profile held by the 
service system or in said information. 

A method according to claim 1 , wherein step (b) in- 
volves detemnining multiple locations associated 
with said infonnation, one said location being that 
of a business premises where the item is being of- 
fered and another said location being a predeter- 
mined location specified by the party responsible for 
sending the information to the service system either 
in a user profile held by the service system or in said 
information; said locations all being used to organ- 
ise and/or select what is in said output. 

A method according to any one of the preceding 
claims, wherein for the or each location determined 
in step (b), step (c) involves organising said output 
according to zones of different accessibility from 
said location. 

A method according to claim 6, wherein said zones 
comprise at least two from the following: 
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» convenient walking zone around said loca- 
tion; 

a convenient driving zone around said location; 
an internet-accessible zone with delivery to 
said location. 

8. A method according to claim 1 , wherein said infor- 
mation is sent to the service system over a mobile 
radio structure at the time of capture. 

9. A method according to claim 1 , wherein the cap- 
tured infomnation Is stored and then subsequently 
sent to the service system. 

10. A method according to claim 8 or claim 9. wherein 
said location is the location of the business premis- 
es, this location being included in the infomnation 
sent to the service system. 

11. A method according to claim 1, wherein the 
processing of said information in step (b) involves 
one or more of the following operations: 

extracting data from specific data fields; 
analysing image data included in said informa- 
tion using OCR techniques; 
matching image data included in said infomna- 
tion against stored image data; 
interpreting bar code image data included in 
said information; 

applying speech recognition to recorded audio 
data included in said information. 

12. A method according to claim V wherein said spe- 
cific task is selected by the party responsible for 
sending the information in step (a), the selected 
task being explicitly specified in said information 
sent to the service system. 

13. A method according to claim 1, wherein said spe- 
cific task comprises one or more of the following: 

obtaining comparative pricing data for said item 
from other business outlets for the item and/or 
obtaining item-availability data concerning 
those business outlets; 

obtaining further information about the item 
from a website associated with a business of- 
fering the item; 

obtaining further information about the item 
from intemet sources; 

ordering further information about the item for 
sending to the party responsible for step (a). 

14. A method according to claim 1 , wherein said output 
is made available to the party responsible for step 
(a) in one or more of the following ways: 



by return over a data channel used to the send 
the information to the service system in step (a); 
by electronic mail to a electronic mail address 
specified in said information or in a user profile 
held by the service system In respect of said 
party; 

by print out and mailing of the print out to a 
physical mail address specified in said informa- 
tion or In a user profile held by the service sys- 
tem in respect of said party; 
by making said output available at a web site 
accessible by said party. 

15. A method according to claim 1, wherein said item 
of interest is a product on offer for sale or hire. 

16. A method according to claim 1, wherein said item 
of interest is a service. 

17. A shopping-assistance service system, comprising: 

receiving means for receiving at the service 
system information about an item of interest on 
offer at a business promises, said information 
including an indication of the location of said 
premises; 

processing means for processing the informa- 
tion to identify at least the type of said item of 
interest and the location of said premises; 
task means for carrying out a specific task re- 
lating to the identified item and delivering an 
output, said location being used to organise 
and/or select what is In said output. 

18. A system according to claim 17, wherein said task 
means is operative to organize said output accord- 
ing to zones of different accessibility from said lo- 
cation. 

19. A shopping-assistance service system, comprising: 

receiving means for receiving at the service 
system information about an item of interest on 
offer at a business premises; 
processing means for processing the informa- 
tion to identify at least the type of said item of 
interest; 

location-determining means for determining a 
location associated with the received informa- 
tion; and 

task means for carrying out a specific task re- 
lating to the identified item and delivering an 
output, said location being used to organise 
said output according to zones of different ac- 
cessibility from said location. 

20. A system according to claim 1 8 or claim 1 9 . wherein 
said zones comprise at least two from the following: 
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- a convenient walking zone around said loca- 
tion; 

- a convenient driving zone around said location; 

- an internet-accessible zone with delivery to 
said location. ^ 

. A system according to clainn 1 7 or 1 9, wherein said 
task means comprises one or more of the following: 

- means for obtaining comparative pricing data io 
for said item from other business outlets for the 
item and/or obtaining item-availability data con- 
cerning those business outlets; 

- means for obtaining further information about 

the Item from a website associated with a busi- is 
ness offering the item; 

- means for obtaining further information about 
the item from internet sources; 

- means for ordering further information about 

the item for provision to the party who sent the 20 
information received by said receiving means. 
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